### prior belief Go back to the [[AI Glossary]] What you believe about the data before you begin training on it. For example, L2 regularization relies on a prior belief that weights should be small and normally distributed around zero.